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Control system for a vehicle 

The invention relates to a control system for a vehicle 
according to the preamble of patent claim 1 . 

10 

In modern vehicles, multimedia control systems are 
being increasingly used. An example of this is the 
command system in the Mercedes Benz S-class. 

15 DE 197 52 056 Al describes a control system for a motor 
vehicle. In this control system, two display areas are 
displayed on a screen display in a menu structure with 
a plurality of menu levels. A first display area is 
arranged as a frame around the second display area. In 

20 a first menu level, eight fields with entries which 
correspond to applications which can be carried out and 
which are arranged vertically and horizontally are 
displayed in the first display area. An entry is 
selected by means of a pushing or tilting movement of 

25 the manual actuating means with a plurality of degrees 
of freedom of adjustment in the direction of the 
position of the corresponding entry in the first 
display area. A selected entry is activated by pressing 
the manual actuating means. After the activation, a 

30 plurality of vertically arranged entries which are 
assigned to the activated entry in the first menu level 
are displayed in a second menu level in the second 
display area. The entries displayed in the second 
display area are selected by means of rotational 

35 movement of the manual actuating means and activated by 
pressing the manual actuating means. The activated 
second display area and the second menu level are 
exited by means of the pushing or tilting movement of 
the manual actuating means in the direction of a 
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position of one of the entries in the first display 
area. The control system is then located in the first 
menu level in the first display area again. 

EP 1 342 605 Al describes a control system for a motor 
vehicle having a screen display, a manual actuating 
means with a plurality of degrees of freedom of 
adjustment and voice control means. The screen display 
comprises a plurality of display areas for displaying 
entries of a menu structure with a plurality of menu 
levels it being possible to select and/or activate the 
entries of the menu structure using the manual 
actuating means and/or the voice control means. The 
entries of the menu structure which are displayed on 
the screen display simultaneously form the keywords 
which can be input at a particular time for voice- 
operated menu control. 

US 4,827,520 describes a control system for a motor 
vehicle having a screen display, a plurality of manual 
actuating means which are arranged in the surroundings 
of the screen display and voice control means . The 
screen display comprises a plurality of display areas 
for displaying entries of a menu structure with a 
plurality of menu levels, it being possible to select 
and/or activate the entries of the menu structure by 
means of the manual actuating means and/or the voice 
control means . The entries of the menu structure which 
are displayed on the screen display or on the manual 
actuating means simultaneously form the keywords which 
can be input at a particular time for voice-operated 
menu control . 

US 4,797,924 describes a control system for a motor 
vehicle having a screen display, a plurality of manual 
actuating means and voice control means . The various 
vehicle components such as the telephone system, radio 
etc. can be controlled either using the manual 
actuating means or the voice control means • For the 
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purpose of voice control/ the terms which can be input 
are ordered in a hierarchical command structure with a 
plurality of command levels, in which case only terms 
of a current command level can be input and are 
5 understood and executed by the voice control means • 

The object of the invention is to specify an improved 
control system for a vehicle by means of which 
intuitive voice control is made possible and the 
10 operating convenience is improved. 

The invention achieves this object by making available 
a control system for a vehicle having the features of 
patent claim 1. 

15 

Advantageous embodiments and developments of the 
invention are specified in the dependent claims. 

The invention is based on the idea of dividing entries 
20 of a menu structure which is displayed on a screen 
display with a plurality of menu levels into various 
groups, a first group comprising entries which can be 
selected and/or activated only with a manual actuating 
means. A second group comprises entries which can be 
25 selected and/or activated with the manual actuating 
means and/or voice control means. In addition, the 
entries of the second group are divided into at least 
two groups of terms which are defined by simple rules 
and which determine which keywords for menu control can 
30 be input by means of voice at a particular time, i.e. 
in the current menu level and/or in the currently 
active display area. 

The control system according to the invention enables 
35 the user to control the menu structure with a plurality 
of menu levels using voice control means and/or the 
manual actuating means. The entries which are assigned 
to the first group comprise, for example, setting 
processes for variable parameters such as volume. 
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balance, bass, treble, fade, transmitter selection of a 
conveyor belt which is animated in an analog fashion or 
a cursor for a radio application etc, which can be set 
most easily with the manual actuating means, for 
example by means of a continuous adjustmental movement. 
The entries which are assigned to the second group and 
which can be operated with the voice control means 
and/or the manual actuating means are simultaneously 
used as a possible keyword for the voice control and 
divided according to the invention into a plurality of 
groups of terms in order to pemit the user to change 
over rapidly between applications and/or the menu 
levels . 

The entries can be divided up, for example, as a 
function of the various display areas and/or menu 
levels. A possible rule is, for example, that all the 
entries of a first display area can only be controlled 
manually, all the entries of a second, fourth and fifth 
display area can be controlled manually and/or by 
voice, and the entries of a third control area can be 
controlled manually in a first and second menu level 
and/or by means of voice, and in a third menu level can 
only be controlled manually. 

By dividing the keywords into a plurality of groups of 
terms, with the groups of terms differing, for example, 
in the menu level and/or the display area in which the 
keywords contained in the respective group of terms can 
be input, the voice control means can be adapted to the 
requirements of various users. 

In one refinement of the invention, the definition 
rules can be used to assign the keywords to various 
groups of terms so that, for example, the keywords 
which are displayed at a particular time in an active 
display area of the screen display can be assigned to a 
first group of terms which are made available to the 
voice control means as a first partial vocabulary. 
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These keywords indicate, for example, to a user which 
input is expected from him in the display area which is 
currently active and/or in the current menu level. As a 
result, an unpracticed user who only has to use these 
5 keywords for control is reliably guided through the 
menu structure . 

In a further configuration, local keywords can be 
assigned to a second group of terms which are made 
available to the voice control means as a second 
partial vocabulary in addition to the first partial 
vocabulary, the local keywords which can be input being 
dependent on the current menu level. As a result, with 
more practice it is possible for a user to input by 
voice keywords which are not displayed in the currently 
active display area by means of entries but rather are 
associated with the direct surroundings of the selected 
application. 

In a further configuration it is possible to assign 
global keywords to a third group of terms which are 
made available to the voice control means as a third 
partial vocabulary in addition to the first and second 
partial vocabularies, and are independent of the 
current menu level. 

Through the use of the currently displayed entries as 
keywords for the voice control means, an unpracticed 
user is enabled to easily and reliably grasp the 
30 possible keywords in the currently displayed screen 
display and select the associated entries and activate 
them, which improves the intuitive voice control and 
increases the operating convenience for the unpracticed 
user. 

35 

As a result of the additional global and local 
keywords, a practiced user is enabled, when performing 
voice control, to jump over menu levels within the menu 
structure and also input invisible terms by means of 
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voice on the current screen display since it can be 
assumed that the practiced user has committed to memory 
at least selected keywords or keyword combinations 
after a certain period of use. In addition, the 
5 division into different groups makes it possible to 
ensure that the function which matches the current menu 
level or the active display area of the screen display 
is carried out if various functions or various scopes 
of functions are assigned to a keyword in various menu 
10 levels. This also increases the operating convenience 
for a practiced user. 

By inputting an entry by voice it is possible to 
trigger the same functionality as when a corresponding 
15 manual input is made using the manual actuating means, 
for example when a keyword from the third group of 
terms is input by voice. 

Additionally or alternatively, the functionality can be 

20 restricted after a voice input compared to a manual 
input, for example when a keyword is input by voice 
from the first or second group of terms, the 
restriction of the functionality being dependent on the 
current menu level and/or on the active display area. 

2 5 For example it is possible to provide that a voice 
input selects a specific entry, i.e. places a cursor on 
this entry, and that the entry is activated by an 
additional manual control procedure, for example by 
pressing the manual actuating means. In addition it is 

30 possible to provide that opened display areas can be 
closed as a function of the menu level only by means of 
a manual input and remain opened after a voice input. 
Furthermore it may be more advantageous from the user's 
point of view to activate directly an entry by voice 

35 input or by manual input and to permit inclusive 
setting, for example of a parameter, exclusively using 
the manual actuating means . 
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In one configuration of the control system according to 
the invention, entries which are input from a list by 
voice are identified, for example, by means of 
numbering placed in front of them or after them. In 
5 order to select and/or activate the entry by means of a 
voice input it is then possible to input both the entry 
which is identified by the numbering system and the 
corresponding digit of the numbering system by voice. 

Additionally or alternatively it is possible for the 
entries which can be input by voice to be identified by 
means of a particular visual representation on the 
screen in which the entries which can be input by voice 
are identified by a different color and/or a different 
intensity and/or a different size and/or a different 
shape . 

If different functions which can be carried out are 
assigned to a keyword as a function of the menu level 
20 and/or the active display area, the function of the 
current menu level and/or of the active display area is 
carried out when such a keyword is input by voice. 

In one application of the control system according to 
25 the invention in a motor vehicle, the third group of 
terms comprises, for example, in each case a keyword 
for application groups which can be controlled in the 
vehicle such as navigation system, audio system, 
telephone/communications system, video/TV system, air 
30 conditioning system and/or vehicle comfort systems such 
as duration of night lights in the passenger 
compartment lighting system, seat adjustment means 
etc., with which the respective application group can 
be selected and/or activated. In addition, the third 
35 group of terms can comprise keywords for applications 
of these groups of applications which can be selected 
from corresponding application menus. In the case of an 
audio system, the associated audio application menu 
comprises, for example, the subapplications of radio. 
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CD, DVD etc. which can then be respectively selected by 
means of a global keyword. Furthermore, global keywords 
are provided for returning to the previous screen 
display, for example ^^back", and for aborting the 
5 current voice input, for example ^^error'' or ^^abort"'. 

The second group of terms comprises, for example, all 
the keywords for functions which are assigned to the 
respective application and which can be input by voice, 
10 irrespective of whether or not they are currently 
displayed in the active display area. 

Keywords of the first group of terms are preferably all 
the entries for subfunctions of the selected function 
15 which are displayed in the currently active display 
area . 



In addition, the keywords can also comprise dynamic 
entries from the three groups of terms, said dynamic 

20 entries changing on the basis of variable peripheral 
conditions, for example names of currently receivable 
radio transmitters, or changing system states, for 
example functions and/or subfunctions and/or options 
which can be carried out and which are dependent on the 

25 current system state. 

Advantageous embodiments of the invention are 
illustrated in the drawings and will be described 
below . 

30 

In said drawings: 



Fig. 1 is a block circuit diagram of a control system 

for a motor vehicle; 
35 Fig. 2 is a schematic illustration of a screen display 

from Fig. 1 in a first menu level; 
Fig. 3 is a schematic illustration of the screen 

display from Fig. 1 in a third menu level; 
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Fig. 4 



Fig. 5 



Fig. 6 



Fig. 7 



Fig. 8 
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illustration of the screen 
1 in a second menu level; 
illustration of the screen 
1 in a third menu level; 
illustration of the screen 
1 in a fourth menu level; 
illustration of the screen 
1 in a fifth menu level; and 
illustration of the screen 
1 in a second menu level. 



As is apparent from Fig. 1, the control system 1 for a 
motor vehicle comprises a screen display 2, a manual 
actuating means 3, a control and evaluation unit 4, 

15 voice control means 6, and a plurality of vehicle 
systems such as a navigation system, a heating system 
and an air conditioning system, a cellular telephone, a 
video system, an audio system etc. which are 
illustrated combined as one element 5. The vehicle 

2 0 systems transmit signals to the evaluation and control 
unit 4 from which the control and evaluation unit 4 
determines current system states. All the applications 
and/or functions and/or subf unctions and/or options 
and/or status displays in various menu levels of a menu 

25 structure are controlled by means of the manual 
actuating means 3. In addition it is possible to 
control predefined applications and/or functions and/or 
subfunctions and/or options and/or status displays in 
various menu levels of the menu structure in a 

30 redundant fashion with respect to control with the 
manual actuating means 3, using the voice control means 
6 by means of a corresponding voice input. 

The voice control means 6 comprise, for example, voice 
35 input means 6.2, for example at least a microphone, a 
voice recognition unit 6.1, voice output means 6.3, for 
example at least one loudspeaker and at least one 
memory unit 6.4. 
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For the purpose of voice control, keywords for the 
voice control means 6 are divided into at least two 
groups of terms which can be defined by simple rules 
and which determine which keywords can be currently 
5 input for the purpose of menu control. A first group of 
terms comprises entries which are displayed at a 
particular time in an active display area of the screen 
display 2 and which simultaneously make available a 
first partial vocabulary as keywords to the voice 

10 control means 6. The keywords of the first group of 
terms are therefore dependent on the active display 
area and/or on the menu level. A second group of terms 
comprises local keywords which are made available as a 
second partial vocabulary to the voice control means 6 

15 in addition to the first partial vocabulary and are 
dependent on the current menu level. A third group of 
terms comprises global keywords which are made 
available to the voice control means 6 as a third 
partial vocabulary in addition to the first and second 

20 partial vocabularies and are independent of the current 
menu level and/or of the active display area. When a 
keyword which is assigned to at least two groups of 
terms is input by voice, the function which is assigned 
to the current menu level and/or the active display 

25 area is carried out. 



The entries which are displayed on the screen display 2 
and which can be input by voice may have an 
identification which is implemented, for example, as a 
30 particular visual display and can be brought about by 
means of a different color and/or a different intensity 
and/or a different size and/or a different shape. This 
is represented by bold in Figs 2 to 8 . 



35 



The manual actuating means 3 has seven degrees of 
freedom of adjustment for selecting and/or activating 
entries displayed in an active display area. Said 
actuating means 3 can be pushed in four directions 
according to the arrow illustration in Fig. 1, i.e. in 
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a positive x direction, a negative x direction, in a 
positive y direction or in a negative y direction. In 
addition, it can be rotated in the clockwise direction 
or in the counter clockwise direction about a z axis 
(not illustrated) which is perpendicular to the plane 
of the drawing, and can be pressed in the direction of 
the negative z direction, i.e. into the plane of the 
drawing . 

Rotating the manual actuating means 3 in the clockwise 
direction causes a cursor on the screen display 2 to 
move to the right or downward as a function of a 
horizontal or vertical orientation of the entries 
displayed on the screen display 2, and turning in the 
counter clockwise direction causes the cursor to move 
to the left or upward. Pushing the manual actuating 
means 3 in Fig. 1 upward, i.e. forward in the direction 
of the windshield, i.e. in the positive y direction, 
causes the cursor on the screen display 2 to move 
upward, and the pushing process in the downward 
direction in Fig. 1, i.e. toward the rear in the 
negative y direction, causes the cursor on the screen 
display 2 to move downward. Pushing to the right, i.e. 
in the positive x direction, causes the cursor on the 
screen display 2 to move to the right, and pushing to 
the left, i.e. in the negative x direction, causes the 
cursor to move to the left. 

The selection and/or activation of an entry displayed 
on the screen display 2 are carried out by pushing or 
turning the manual actuating means 3. The manual 
actuating means 3 can be rotated about the z axis in a 
redundant fashion with respect to the vertical pushing 
along an axis, i.e. with respect to the pushing in the 
y direction, or with respect to the horizontal pushing 
along an axis, i.e. with respect to the pushing in the 
X direction. The pushing direction for selecting an 
entry corresponds here to the orientation of the 
entries displayed in the active display area. The 
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pushing direction, which is respectively orthogonal to 
the selection pushing direction causes the active 
display area to be exited. In addition, in order to 
activate a selected entry it may be necessary to press 
5 the manual actuating means 3. 

As is clear from Fig. 2, the screen display 2 
comprises, in a first menu level, a graphic basic 
structure of five vertically arranged, horizontal 
display areas 210 to 250. This graphic basic structure 
is constant over the multiplicity of various menu 
levels of the menu structure. The screen display 2 is 
configured, for example, as an eight inch screen with a 
ratio of the sides of 15:9. 

The graphic basic structure of the display area 230 is 
variable over the multiplicity of various menu levels 
of the menu structure as a function of an activated 
application and/or function and/or subf unction and/or 
option and/or status display, i.e. this central display 
area 230 may be configured graphically in very 
different ways. 

One or more horizontally arranged entries 1.1 to 5.7 
25 may be respectively displayed in the four display areas 
210, 220, 240 and 250. For example, the display areas 
210, 220, 240 and 250 in Fig. 2 in the first menu level 
each comprise a different number of entries. For 
example, the first display area 210 comprises five 
30 entries 1.1 to 1.5, the second display area 220 
comprises five entries 2.1 to 2.5, the fourth display 
area comprises no entry and the fifth display area 
comprises seven entries 5.1 to 5.7. In Fig. 2, the 
second display area 220 is activated and the hatched 
35 entry 2.1 (Navi) is selected. The hatched display is 
intended to indicate that the cursor is positioned on 
the entry 2.1. 
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The entries 1.1 to 5.7 of the display areas 210 to 250 
displayed on the screen display 2 can be arranged in 
accordance with the importance of their contents or 
frequency of application. 

5 

The schematic illustration of the screen display 2 in 
Figs 2 to 8 is adapted to the control for a motor 
vehicle with specific entries. As is apparent from 
Fig. 2, the first display area 210 is configured as a 

10 status line which presents various status displays 1.1 
to 1.5 from different applications. The main function 
of the status line is to display important current 
system states which are determined by the control and 
evaluation unit 4 as a function of signals from the 

15 vehicle systems 5. The entries and status displays 1.1 
to 1.5 can be selected and activated in the illustrated 
exemplary embodiment only with the manual actuating 
means 3. In order to determine the current system 
states, for example the signals from the navigation 

20 system with a locating unit, from the heating and air 
conditioning system, from the cellular telephone, from 
the video system, from the audio system etc. are 
evaluated. In the status line it is indicated, for 
example, whether a traffic radio transmitter is 

25 activated, whether the heating and air conditioning 
system is operating in the recirculation mode or fresh 
air mode, whether the active carbon filter is activated 
etc . 

30 The first display area 210 which is configured as a 
status line can contain a plurality of controllable and 
uncontrollable entries 1.1 to 1.5 which are input into 
the display or removed from it as a function of the 
system state. The controllability of a number of 

35 entries can permit direct access to important functions 
without making it necessary to change the application. 
If an entry is selected from the status line, this can 
lead directly to an associated function. For example, 
by activating a letter symbol it is possible to 
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activate and open a display area in a ComTel 
application, i.e. in a communication or telephone 
application. Activating a telephone receiver symbol can 
activate and open a different display area in the 
5 ComTel application group. Activating a TP symbol 
deactivates a traffic program, i.e. a traffic radio 
transmitter. In addition, various nonselectable status 
displays such as a satellite key can be displayed in 
order to display the GPS reception or a field strength. 

10 

The second display area 220 is embodied as an 
application line for displaying various selectable and 
predefinable application groups 2.1 to 2.5, in 
particular a navigation application group (Navi) , an 

15 audio application group, a telephone/communications 
application group (Tel/Com) , a video application group 
and a vehicle application group, the number and 
position of the entries to be displayed, i.e. the 
application groups 2.1 to 2.5 being constant and the 

20 graphic representation of the entries to be displayed 
being variable as a function of an activated 
application group. The activation of one of the 
application groups 2.1 to 2.5 which is not already 
active leads to a change into the associated 

25 application and to activation of the fourth display 
area 240 in order to display functions and/or 
subfunctions which are associated with the activated 
application. If an application does not have functions 
or subfunctions, the third display area 230 can be 

30 activated by activating this application in the second 
display area 220, and the options associated with this 
application for the purpose of control are displayed. 

The arrangement of the application groups in the second 
35 display area 220 is constant and can be ordered from 
left to right according to frequency of use or 
importance. Selecting an application or application 
group brings about direct activation of at least one 
other display area and can be carried out by manual 
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input with the manual actuating means 3 or by voice 
input using the voice control means. The entries 2.1 to 
2.5 of the application line 220 which are identified by 
bold are assigned as keywords to the first group of 
5 terms which comprise keywords of the active display 
area. Since none of the entries from one of the five 
display areas has yet been activated, the entire screen 
in Fig. 2 corresponds to the active display area. In 
addition, in the illustrated exemplary embodiment the 
10 entries 2.1 to 2.5 are assigned as global keywords to 
the third group of terms. 

The third display area 230 is configured as an 
application area for displaying details and controlling 
15 a selected and activated application. The number and 
the position as well as the graphic representation of 
the entries to be displayed are dependent on the 
activated application 2.1 to 2.5. The graphic 
representation and controllability of the third 

20 display area 230 are variable and can therefore be well 
matched to a greatly varying functionality or 
requirements of the various applications 2.1 to 2.5. 

The fourth display area 240 is configured as a function 
line for displaying and selecting functions and/or 
subfunctions and/or options of an activated application 
2.1 to 2.5. The number and the position and the graphic 
representation of the entries to be displayed, i.e. of 
the functions and/or subfunctions are dependent on the 
activated application 2.1 to 2.5 and/or on the menu 
level. The graphic basic structure is constant over all 
menu levels of the menu structure. 

The fifth display area 250 is configured as a main 
35 application line. A presettable application can be 
displayed in this display area 250. The number and the 
position of the entries 5.1 to 5.7 to be displayed are 
constant for the preset application, and the contents 
and the graphic representation of the entries 5.1 to 
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5.7 to be displayed are variable and/or constant as a 
function of current system states. The preset 
application is preferably used to control an air 
conditioning system in the vehicle. The entry 5.1 (air 
5 conditioning) which can be selected and/or activated by 
means of a voice input is identified by bold and is 
assigned to the first and third groups of terms. The 
displayed values of a set parameter, such as for 
example air temperature, blower setting etc., can vary. 

10 The current system states relate in particular to 
states which are relevant to temperature control in the 
passenger compartment of a vehicle such as, for 
example, the external temperature, intensity of solar 
radiation, temperature of the passenger compartment, 

15 air humidity etc. 

Fig. 4 shows the screen display 2 in a further menu 
level after the entry 2.2 (audio) in the second display 
area 22 0 has been selected by pushing the manual 

20 actuating means 3 in the positive x direction and has 
been activated by pressing the manual actuating means 
3, or has been selected and activated by voice input of 
the entry 2.2 "'audio". Activation of the entry 2.2 
opens and activates the application menu assigned to 

25 the entry 2.2 in the display area 220.1. In the 
application menu 220.1, for example six entries are 
displayed and these are assigned to the third group of 
terms, one entry '"radio" of which being selected. This 
is indicated by the circle in front of it. Since the 

30 corresponding display area 220,1 is active, the entries 
of the application menu 220.1 in this menu level are 
additionally assigned to the first group of terms. The 
activation of the entry 2.2 ""audio" causes the entries 
4.1 to 4.4 of the function line which are associated 

35 with the radio application selected in the application 
menu 220.1 to be displayed in the fourth display area 
240. The entries 4.1 to 4.4 of the function line are 
assigned to the second group of terms as local keywords 
which are associated with the radio application. 
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Furthermore, activation of the entry 2.2 '"audio" causes 
the display area 230.1 which is associated with the 
selected radio application to be opened in the third 
display area 230. The entries transmitterl to 
5 transmitters which are shown in the opened display area 
230.1 correspond to selectable radio stations. In the 
screen display 2 which is shown in Fig. 4, the entries 
of the application menu 220.1 which is currently active 
can be selected and activated with the manual actuating 

10 means 3 by means of a corresponding adjustment 
movement. In addition, the active display area 220.1 
can be exited and closed again by means of a 
corresponding adjustment movement. By means of a voice 
input it is possible for an entry in the screen display 

15 2 shown in Fig. 4 to be selected from the display area 
220.1 and activated, as a result of which the 
application menu is subsequently exited and closed. In 
addition, by inputting one of the global keywords from 
the third area of terms which comprises the entries of 

20 the application line 2.1 to 2.5 which can be input by 
voice, of the main application line 250 and the entries 
of the application menus which are assigned to the 
respective applications and which can be input by voice 
it is possible to change into another display area. In 

25 this way it is possible, for example by inputting one 
of the keywords by voice, to change from the 
application line 220 into an application menu, assigned 
to the input entry, for a further control operation, as 
a result of which the currently active display area 

30 220.1 is also exited and closed. A voice input of one 
of the local keywords from the second group of terms, 
for example one of the entries from the display area of 
the function line 240, causes the assigned function to 
be activated. This makes clear how a rapid changeover 

35 between the applications and thus between the 
individual menu levels is possible through the 
inventive grouping of the keywords without running 
backwards through the menu structure. In order to 
indicate that the application menu 20.1 is active, the 
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other display areas can be subdued, for example can be 
displayed with a darker color and/or the application 
menu 220.1 can be visually highlighted, for example can 
be displayed in a brighter color. As a result, it is 
5 clear to the user, in particular even an unpracticed 
user, that a corresponding manual input or voice input 
for selecting an entry from the application menu 220.1 
is expected from him in this menu level. 

Through the manual activation or through the activation 
by voice input of the entry ""radio" which is selected 
in the application menu 220.1, the user arrives at the 
screen display 2 which is illustrated in Fig. 1 and in 
which the application ""radio'' of the application group 
""audio" is active with the settings which were set 
before the application was exited last. 

The user also arrives at the screen display illustrated 
in Fig. 3 if he inputs the global keyword ""radio" in 
20 the first menu level from Fig. 2 by means of a voice 
input. In Fig. 3, the application group 2.2 ""audio" in 
the application line 220 is selected and the function 
""radio" which is assigned to the application ""radio" is 
selected in the function line 240. In the display area 
25 230, the entry ""transmitter3" in the display area 230.1 
is selected and activated by means of the cursor 
illustrated as a perpendicular bar. The transmitter 
setting can be made by means of a corresponding manual 
adjustment process with the manual actuating means 3 or 
30 by inputting the local keyword ""next transmitter". The 
currently displayed keywords of the first area of terms 
are the entries 4.1 to 4.4 of the function line 240 
which are marked by bold and which are opened if one of 
the functions is activated by correspondingly selecting 
35 and activating the assigned entry from the function 
line 240. In the illustrated exemplary embodiment, the 
entries of the display area 230.1 cannot be controlled 
by voice input since the rule applies that within the 
display area 230 only entries which are displayed as a 
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vertical list or horizontal list can be controlled by 
voice input. However, in an alternative embodiment it 
is possible to provide for all text entries of the 
third display area 230 to be able to be controlled by 
5 voice input. 



10 



The keyword '"radio" is an example of different 
functionalities which can be assigned to a keyword. 
When the keyword "'radio'' in Fig. 4 is input by voice, 
the radio application is activated, the application 
menu 220.1 is closed and the system changes to the 
display according to Fig. 3. When the keyword ""radio" 
in Fig. 3 is input by voice, a function menu of the 
radio application (not illustrated) is opened for the 
15 purpose of further control, in which case for example a 
transmitter search, transmitter save process etc. can 
be selected and/or activated in this function menu. 



20 



If the user inputs the global keyword ""CD" in the 
screen display 2 from Fig. 2 or 3 (said keyword is not 
illustrated there) from the audio application menu 
220.1, he arrives at the screen display 2 from Fig. 5. 
This screen display is reached even if the entry ""CD" 
illustrated in the application menu 220.1 from Fig. 4 
25 is selected in said menu by voice input or manual input 
and activated. The subapplication ^^CD" is carried out 
with the settings which were set before the 
subapplication was exited last. In the screen display 2 
from Fig. 3, the application ""audio" in the application 
line 220 and the entry ""CD" in the function line 240 
are selected. Two further display areas 230.2 and 230.3 
which display the settings of the subapplication ""CD" 
are displayed in the display area 230. The entries of 
the application line 2.1 to 2.5, of the function line 
4.1 to 4.4 and the entry 5.1 of the main application 
""air conditioning system", are marked by bold in the 
screen display and can be input as keywords by voice 
input. In addition, all the local and global keywords 
can be input. 
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If the local keyword ^'sound'' is input in one of the 
menu levels from Figs 3 or 5, the screen display 2 
changes into the menu level from Fig. 6. As is apparent 
5 from Fig. 6, four display areas 2 30.4 ''treble", 230.5 
^^bass", 230.6 ^^balance/fader" and 230.7 ^^surround 
sound" in this menu level are displayed for the 
selection and/or activation and/or setting of 
associated subfunctions in the active third display 

10 area 230. In the second menu line 220, the activated 
application 2.2 ""audio" is activated, which is 
indicated by the hatched display of the associated 
field. In the subf unction line 231 of the third display 
area 230, the selected subfunction 3.1 '"treble" is 

15 correspondingly marked by a hatched display. One of the 
displayed entries 3.1 to 3,4 from the subfunction line 
can be by means of a corresponding manual input with 
the manual actuating means 3 or by a voice input using 
the voice control system. Moreover, the local and 

20 global keywords mentioned above can be input. In 
Fig. 6, a further global keyword ""back" is displayed in 
the subfunction line 240. This keyword leads in all the 
menu levels to a return to the previous display on the 
screen display 2. If in the screen display 2 displayed 

25 in Fig. 6 the subfunction ""bass" is selected and 
activated, for example by a manual input or by a voice 
input, the screen display 2 shows the display according 
to Fig. 7. 

30 As is apparent from Fig. 7, the display area 230.5 
there is activated in order to set the subfunction 
""bass" parameter. This is indicated to the user by a 
display area 230.5 which is enlarged compared to the 
display from Fig. 6. The subfunction can now be set 

35 with the manual actuating means 3. The subfunction 
"'bass" parameter is currently set to the value 0. If a 
submenu is configured as a list with text entries as in 
Fig. 7 or 8, the number of entries can be unlimited, 
the number of maximum visible entries being limited. 
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for example to nine entries . When there are more than 
nine entries, an entry can be selected by scrolling. 
The indication that further invisible entries are 
present can be provided by means of arrows. In order to 
5 be able to scroll by voice input, a corresponding 
keyword can be displayed next to the arrow, for example 
^'forward" or ^'back". 

Fig. 8 shows a representation of the screen display in 
10 the menu level from Fig. 3 in which, in contrast to the 
representation from Fig. 3, the individual list 
elements of the application menu 220.1 are identified 
by numbering placed in front of them. In the 
illustrated exemplary embodiment, the numbering is 
15 implemented by a rising numerical sequence. However, it 
is alternatively also possible to use letters to 
identify the individual list elements. In addition, the 
numbering can also be placed after the individual list 
elements . The numbering indicates to the user both that 
20 the list elements can be selected and/or activated by 
voice input and that the selection and/or activation 
can also be carried out by voice input of the 
corresponding character, i.e. number of letter, which 
is assigned to the desired list element. 

25 

Basically, all the displayed entries 1.1 to 5.7 can be 
selected with the manual actuating means 3. Only a 
small number of status displays and options which are 
not available at certain times are exempted. Not all 

30 entries displayed can be selected by rotation. In each 
display area 210 to 250 only a number of elements which 
are correspondingly graphically highlighted can be 
selected directly by rotation. The other entries are 
firstly activated by pushing the manual actuating means 

35 3 orthogonally with respect to the graphically 
highlighted area. The activity state, i.e. the 
possibility of direct selection, of a display area 210 
to 250 or of individual entries is displayed, for 
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example, by different colored elements and different 
graphic elements . 

In at least one of the display areas 210 to 250, the 
5 cursor is not an independent object on the screen 
display 2 but rather assumes the shape of the field in 
which it is positioned. In the described configuration, 
this applies to the first, second, fourth and fifth 
display areas 210, 220, 240, 250. The cursor is 

10 displayed by changing the graphic representation of the 
field on which it is positioned, for example by 
changing the color of the background of the respective 
entry 1.1 to 5.7, with the inversion of the colors of 
the display of the entry 1.1 to 5.7. The positioning of 

15 the cursor on a field represents the selection of the 
entry associated with this field. It is possible to 
depart from this display if a parameter setting can 
already be implemented by rotating or pushing the 
cursor, or if the entry is represented graphically 

20 instead of as text. In this case, the cursor is 
displayed with a different graphic form. This type of 
cursor display can be limited spatially to the third 
display area 230. 

25 The cursor is always positioned within what is referred 
to as an active display area 210 to 250, i.e. in a 
display area 210 to 250 which can be controlled 
directly and in which one of the entries can be 
selected and/or activated by rotating and pushing the 

30 manual actuating means 3 either horizontally or 
vertically as a function of the orientation of the 
entries 1.1 to 5.7. This active display area 210 to 250 
is orientated either vertically or horizontally. 

35 The entries of the active display area 210 to 250 can 
be highlighted through color, for example by a light 
script and/or icons and/or graphics on a dark 
background, text entries corresponding to the keywords 
can be input by voice. In addition, this display area 
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can be delimited by a horizontal or vertical light line 
which serves, for example, to indicate the direction of 
rotation. In the third display area 230, the activation 
state can be displayed by means of a highlighted entry 
5 and/or by means of the highlighted cursor. 

The display areas 210 to 250 which are not directly 
active can be represented in a graphically subdued 
fashion, for example by means of a different color 
and/or different intensity. These unactivated displaye 
areas 210 to 250 can be selected by respectively 
orthogonally pushing the manual actuating means 3 with 
respect to the orientation of the entries in the active 
display area 210 to 250. Furthermore, it is possible to 
select the nonactive display areas 210 to 250 by a 
corresponding voice input of local or global keywords 
from the second or third group of terms. 

Entries which cannot be selected for a certain time can 
nevertheless be displayed, for example, in an 
attenuated form with color contrast. The cursor cannot 
be moved* onto such entries. These entries can, for 
example, be jumped over or the movement of the manual 
actuating means 3 can be limited, for example, in the 
form of a stop, which prevents the cursor being moved 
onto the field which cannot be selected. If such an 
entry is inadvertently input by voice input, the user 
receives the visual and/or audible message that the 
entry is not available at present. Likewise, it is 
possible to respond to voice inputs for the selection 
of nonimplemented components . 

According to the invention, in the illustrated 
application in a motor vehicle possible global keywords 
35 of the third group of terms are the entries for the 
application groups navigation system 2.1, audio system 
2.2, telephone/communication system 2.3, TV/video 
system 2.4, vehicle systems 2.5 and heating and air 
conditioning system 5.1. In addition, the entries of 
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the application menus which are assigned to the 
application groups are global keywords from the third 
group of terms . The navigation application menu thus 
comprises, for example, global keywords for the 
5 selectable applications or options such as start 
navigation, abort navigation, show map, dynamic mode 
etc. The audio application menu comprises, for example, 
global keywords for the selectable applications or 
options such as radio, CD, audio, DVD, MPS, audio off 

10 etc. The telephone/communications application menu 
comprises, for example, global keywords for the 
selectable applications or options such as browser, 
address book, notebook, telephone, messages, radio 
services, telephone off etc. The TV/video application 

15 menu comprises, for example, global keywords for the 
selectable applications or options such as DVD, TV, 
video off, etc. The vehicle system application menu 
comprises, for example global keywords for the 
selectable applications or options such as setting 

20 exterior rear view mirror, nightlight time, surround 
lighting, tailgate boundaries etc. The global keywords 
are, as has already been stated above, recognized by 
the voice control means 6 in all the menu levels and 
passed on to the evaluation and control unit 4 in order 

25 to carry out the assigned functionality. 

Possible local keywords for entries of the second group 
of terms are the entries in the function line 2 40 which 
are assigned to the applications. For example, the 

30 navigation application group in the function line 
comprises, for example when the navigation system is 
switched off, local keywords for the selectable 
functions or options such as position, destination, 
full image etc. When the navigation system is selected, 

35 the navigation application group in the function line 
240 comprises, for example, local keywords for the 
functions or options such as route, position, repeat 
driving instruction, destination, full image etc. The 
audio application group comprises in the function line 
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240, when the application radio is selected, for 
example local keywords for the selectable functions or 
options such as radio, memory, sound, VHF etc. When the 
CD or DVD application is selected, the function line 
5 240 comprises, for example, local keywords for the 
selectable functions or options such as CD, title list, 
changer, sound etc. For the selected application MP3, 
the function line 240 comprises, for example, local 
keywords for the selectable functions or options MPS, 

10 title, file, changer and sound. The 

telephone /communications application group comprises in 
the function line 240 for the selected application 
address book, for example, local keywords for the 
selectable functions or options such as search and new 

15 entry. The selected application news comprises in the 
function line 240, for example, local keywords for the 
selectable functions or options such as input, new, 
drafts, output, messages etc. The TV/video application 
group comprises in the selected application TV, for 

20 example, local keywords for the selectable functions or 
options such as memory, teletext, sound etc. The 
vehicle system application group comprises in the 
function line 240, for example, local keywords for the 
selectable functions or options for system settings and 

25 user profiles. The local keywords are, as has already 
been stated above, recognized by the voice control 
means 6 as a function of the menu level, i.e. the 
selected and activated application group, and passed on 
to the evaluation and control unit 4 for execution of 

30 the assigned functionality. 

Possible keywords for entries of the first group of 
terms are the entries which are assigned to the 
functions in the associated function menu. The first 
35 group of terms comprises in the selected application 
group navigation keywords for a function menu for the 
inputting of addresses such as input location, street, 
house niimber, start navigation etc. as a function of 
the active display area 210 to 250, and in the case of 
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a function menu for the destination memory it comprises 
the keywords delete, change etc. as a function of the 
active display area 210 to 250. In the selected 
application group audio, the first group comprises, for 
example, keywords for a function menu sound such as 
treble, bass, balance/fader etc. In the selected 
TV/video application group, the first group comprises, 
for example, keywords for a teletext function menu. In 
the selected vehicle system application group, the 
first group comprises, for example, keywords for a 
function menu password entry or for a function menu 
seat . 

The configurations described with, respect to the 
drawings show that the invention can be used to control 
a very wide variety of applications and/or functions. 
Dividing the selectable and/or activatable entries of a 
menu structure displayed on a screen display with a 
plurality of menu levels into various groups improves 
the intuitive voice control and the operating 
convenience both for an unpracticed user, to whom the 
possible keywords are displayed in the screen display 
which is currently being displayed, and for a practiced 
user who is allowed to jump over menu levels within the 
25 menu structure and also use voice to input terms which 
cannot be seen on the current screen display since it 
can be assumed that the practiced user has committed to 
memory at least selected keywords or keyword 
combinations after a certain period of use. 
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